Audio enhanced messaging

ABSTRACT

Techniques for acquiring, sending, receiving or using status information from a remote location over a network are disclosed. The status information is transmitted over the network between or among electronic devices. The status information can be provided by one or more sensors associated with the electronic device that is transmitting the status information. The status information can be transmitted with messages so as to enhance the messages. On receipt, the status information can be presented in an audio manner. The electronic devices include at least computing devices, such as computers, personal digital assistants, pagers, and mobile telephones.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.15/686,960, filed Aug. 25, 2017, and entitled “METHOD AND SYSTEM FORENHANCED MESSAGING USING EMOTIONAL AND LOCATIONAL INFORMATION,” which ishereby incorporated by reference, which in turn is a continuation ofU.S. patent application Ser. No. 15/457,978, filed Mar. 13, 2017, andentitled “METHOD AND SYSTEM FOR ENHANCED MESSAGING USING EMOTIONALINFORMATION,” (now U.S. Pat. No. 9,769,630) which is hereby incorporatedby reference, which in turn is a continuation of U.S. patent applicationSer. No. 15/272,559, filed Sep. 22, 2016, and entitled “METHOD ANDSYSTEM FOR ENHANCED MESSAGING,” (now U.S. Pat. No. 9,596,579), which ishereby incorporated by reference, which in turn is a continuation ofU.S. patent application Ser. No. 14/727,798, filed Jun. 1, 2015, andentitled “METHOD AND SYSTEM FOR ENHANCED MESSAGING,” (now U.S. Pat. No.9,456,350), which is hereby incorporated by reference, which in turn isa continuation of U.S. patent application Ser. No. 13/802,594, filedMar. 13, 2013, and entitled “METHOD AND SYSTEM FOR ENHANCED MESSAGING,”(now U.S. Pat. No. 9,049,571), which is hereby incorporated byreference, which in turn is a continuation of U.S. patent applicationSer. No. 13/459,025, filed Apr. 27, 2012, and entitled “METHOD ANDSYSTEM FOR ENHANCED MESSAGING,” (now U.S. Pat. No. 8,447,822), which ishereby incorporated by reference, which in turn is a continuation ofU.S. patent application Ser. No. 13/113,972, filed May 23, 2011, andentitled “METHOD AND SYSTEM FOR ENHANCED MESSAGING,” (now U.S. Pat. No.8,176,135), which is hereby incorporated by reference, which in turn isa continuation of U.S. patent application Ser. No. 12/214,434, filedJun. 19, 2008, and entitled “METHOD AND SYSTEM FOR ENHANCED MESSAGING,”(now U.S. Pat. No. 7,953,809), which is hereby incorporated herein byreference, which in turn is a continuation of U.S. patent applicationSer. No. 10/397,474, filed Mar. 26, 2003, and entitled “METHOD ANDSYSTEM FOR ENHANCED MESSAGING,” (now U.S. Pat. No. 7,403,972), which ishereby incorporated herein by reference, and which in turn claimsbenefit of: (i) U.S. Provisional Patent Application No. 60/444,198,filed Jan. 30, 2003, and entitled “SYSTEM, METHOD AND APPARATUS FORACQUIRING, PRESENTING, MONITORING, DELIVERING, MANAGING AND USING STATUSINFORMATION,” which is hereby incorporated herein by reference; (ii)U.S. Provisional Patent Application No. 60/418,491, filed Oct. 15, 2002,and entitled “SYSTEM, METHOD AND APPARATUS FOR ACQUIRING, PRESENTING,MONITORING, DELIVERING, MANAGING AND USING STATUS INFORMATION,” which ishereby incorporated herein by reference; (iii) U.S. Provisional PatentApplication No. 60/404,645, filed Aug. 19, 2002, and entitled “SYSTEM,METHOD AND APPARATUS FOR ACQUIRING, PRESENTING, MONITORING, DELIVERING,MANAGING AND USING POSITION AND OTHER INFORMATION,” which is herebyincorporated herein by reference; and (iv) U.S. Provisional PatentApplication No. 60/375,998, filed Apr. 24, 2002, and entitled “SYSTEM,METHOD AND APPARATUS FOR ACQUIRING, PRESENTING, MANAGING AND USINGPOSITION INFORMATION,” which is hereby incorporated herein by reference.

This application is also related to: (i) U.S. patent application Ser.No. 10/397,473, filed Mar. 26, 2003, and entitled “METHOD AND APPARATUSFOR INTELLIGENT ACQUISITION OF POSITION INFORMATION,” (now U.S. Pat. No.6,975,941); (ii) U.S. patent application Ser. No. 10/397,472, filed Mar.26, 2003, and entitled “METHODS AND APPARATUS TO ANALYZE AND PRESENTLOCATION INFORMATION,” (now U.S. Pat. No. 7,218,938); (iii) U.S. patentapplication Ser. No. 10/397,637, filed Mar. 26, 2003, and entitled“METHOD AND SYSTEM FOR PROVIDING SHIPMENT TRACKING AND NOTIFICATIONS,”(now U.S. Pat. No. 7,212,829); (iv) U.S. patent application Ser. No.10/397,641, filed Mar. 26, 2003, and entitled “METHOD AND SYSTEM FORPERSONALIZED MEDICAL MONITORING AND NOTIFICATIONS THEREFOR,” (now U.S.Pat. No. 7,905,832); (v) U.S. patent application Ser. No. 10/397,640,filed Mar. 26, 2003, and entitled “INEXPENSIVE POSITION SENSING DEVICE,”(now U.S. Pat. No. 7,321,774); (vi) U.S. patent application Ser. No.10/397,512, filed Mar. 26, 2003, and entitled “APPLICATIONS OF STATUSINFORMATION FOR INVENTORY MANAGEMENT.”

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to communication devices and, moreparticularly, to enhanced messaging for communication devices.

2. Description of the Related Art

Today, electronic mail (email) is a common mode of communication. Oneperson, acting as a sender, composes an email message and then sends theemail message to another person designated as a recipient. The sendercomposes the email message by interacting with a communication device.The recipient is able to read the email message by interacting withanother communication device. Communication devices are often personalcomputers or mobile telephones. These communication devices can receiveand transmit electronic mail messages over a network. The network can bepublic or private as well as wired or wireless.

Although email is an effective means of communication, when a sender isusing a mobile telephone, composing an email message can be tedious anddifficult. User interfaces can provide limited assistance to users suchas by creating email messages through word prediction, predeterminedresponses, etc. Nevertheless, given the difficulties with composingmessages, email messages from mobile telephones in most cases arerelatively short. Recently, communication devices, including mobiletelephones, have been able to send and receive instant messages, whichare short text messages sent and received in near real time betweencommunication device.

Apart from sending and receiving email messages, mobile telephones canalso display the location or availability (i.e., online or offline) ofother users via their mobile telephones. This information is provided bya wireless service provider that monitors location or availability ofusers via their mobile phones. Unfortunately, such information needs theassistance of wireless service providers and tends not to be widelyavailable. Moreover, if such information is available, the informationwould very likely not be current and thus the usefulness of theinformation would be limited.

Thus, there is a need for improved approaches to enhance thecapabilities of messaging.

SUMMARY

Broadly speaking, the invention relates to techniques for acquiring,sending, receiving or using status information from a remote locationover a network. The status information is transmitted by electronicdevices over the network. The status information can be provided by oneor more sensors associated with the electronic device that istransmitting the status information. The status information can betransmitted with messages so as to enhance the messages.

According to one aspect of the invention, base messages are entered by auser or automatically produced. The base messages can be text messages(including instant messages), voice messages, video messages or othertypes of messages. The base messages are augmented to additionallyinclude status information, such as position and/or other conditionsinformation. The status information is normally provided by one or moresensors. In one implementation, base messages can be combined withstatus information, whereby the resulting messages are referred to asenhanced messages. These enhanced messages are electronically sent fromand received at electronic devices, such as personal computers andmobile communication devices.

The invention can be implemented in numerous ways including, a method,system, device, graphical user interface, and a computer readablemedium. Several embodiments of the invention are discussed below.

As a method to facilitate communication among users of mobile electronicdevices user communication system for communicating between users ofmobile communication devices, one embodiment of the invention can, forexample, include at least the acts of: receiving message content for atext message via the first mobile electronic device; acquiring statusinformation of the first mobile electronic device, the statusinformation including at least position information associated with thefirst mobile electronic device; determining a plurality of other mobileelectronic devices or users thereof that are authorized to receive themessage content and the status information; determining whether at leastone user selection has been provided via the first mobile communicationdevice to indicate whether the status information is to be provided withthe text message, and initiating sending of the text message includingthe message content along with the status information to each of theplurality of other mobile electronic devices via a wireless network,provided that it is determined that the status information is to beprovided with the text message and provided that the plurality of othermobile electronic devices or users thereof are authorized to receive thetext message.

As a computer readable medium including at least computer program codetangible stored thereon for facilitating communication among users ofmobile electronic devices, one embodiment of the invention can, forexample, include at least: computer program code for receiving messagecontent for a text message via the first mobile electronic device;computer program code for acquiring status information of the firstmobile electronic device, the status information including at leastposition information regarding position of the first mobile electronicdevice; computer program code for determining a plurality of othermobile electronic devices or users thereof that are authorized toreceive the status information; computer program code for determiningwhether at least one indication has been received from the first mobilecommunication device to influence whether the status information is tobe provided with the text message; computer program code for determiningbased at least in part on the at least one indication whether the statusinformation is to be provided with the text message, and computerprogram code for initiating sending of the text message along with thestatus information to each of the plurality of other mobile electronicdevices via at least one wireless network, provided that it isdetermined that the status information is to be provided with the textmessage and provided that the plurality of other mobile electronicdevices or users thereof are authorized to receive the statusinformation.

As a method for providing communications between computing devices,another embodiment of the invention includes at least the acts of:obtaining a message at a first mobile communication device to bedelivered to a second mobile communication device; determining whetherstatus information is to accompany the message; sending the messagewithout any status information when it is determined that statusinformation is not to accompany the message; and acquiring statusinformation at the first mobile communication device and then sendingthe message and the status information to the second mobilecommunication device when it is determined that status information is toaccompany the message.

As a method for displaying a message on a display device of a computingdevice, one embodiment of the invention includes at least the acts of:receiving a message from another computing device over a network;determining whether the message includes at least status information;extracting the status information from the message when it is determinedthat the message includes at least the status information; anddisplaying the message and at least one representation of the statusinformation on the display device following the extracting when it isdetermined that the message includes at least the status information.

As a method for displaying a message on a display device of a computingdevice, another embodiment of the invention includes at least the actsof: receiving a message from another computing device over a network;determining whether the message includes at least status information;extracting the status information from the message when it is determinedthat the message includes at least the status information; anddisplaying the message and at least one representation of the statusinformation on the display device following the extracting when it isdetermined that the message includes at least the status information.

Other aspects and advantages of the invention will become apparent fromthe following detailed description taken in conjunction with theaccompanying drawings which illustrate, by way of example, theprinciples of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be readily understood by the following detaileddescription in conjunction with the accompanying drawings, wherein likereference numerals designate like structural elements, and in which:

FIG. 1 is a block diagram of an enhanced messaging system according toone embodiment of the invention.

FIG. 2 is a block diagram of an enhanced messaging system according toanother embodiment of the invention.

FIG. 3 is a flow diagram of status message processing according to oneembodiment of the invention.

FIG. 4 is a flow diagram of send processing according to one embodimentof the invention.

FIG. 5 is a flow diagram of display processing according to oneembodiment of the invention.

FIG. 6 is a flow diagram of status retrieval processing according to oneembodiment of the invention.

FIG. 7 is a flow diagram of status request processing according to oneembodiment of the invention.

DETAILED DESCRIPTION OF THE INVENTION

The invention relates to techniques for acquiring, sending, receiving orusing status information from a remote location over a network. Thestatus information is transmitted over the network between or amongelectronic devices. The status information can be provided by one ormore sensors associated with the electronic device that is transmittingthe status information. The status information can be transmitted withmessages so as to enhance the messages. The electronic devices includeat least computing devices, such as personal computers, personal digitalassistants, pagers, and mobile telephones.

According to one aspect of the invention, messages are enhanced throughuse of status information. Base messages are entered by a user orautomatically produced. The base messages can be text messages(including instant messages), voice messages, video messages or othertypes of messages. The base messages are augmented to additionallyinclude status information, such as position and/or other conditionsinformation. The status information is normally provided by one or morestatus sensors. In one implementation, base messages can be combinedwith status information, whereby the resulting messages are referred toas enhanced messages. These enhanced messages are electronically sentfrom and received at communication devices, such as personal computersand mobile communication devices.

Different embodiments of the invention are discussed below withreference to FIGS. 1-7. However, those skilled in the art will readilyappreciate that the detailed description given herein with respect tothese figures is for explanatory purposes as the invention extendsbeyond these limited embodiments.

According to one aspect of the invention, traditional messagestransmitted between communication devices are augmented to additionallyinclude status information, such as position and/or conditionsinformation. The conditions information can pertain to one or more ofenvironmental conditions, device-related conditions, or user-relatedconditions. One or more status sensors associated with the communicationdevices can capture or obtain the status information. In the case ofposition information, the status sensor can be a receiver, such as aGlobal Positioning System (GPS) receiver or other means.

FIG. 1 is a block diagram of an enhanced messaging system 100 accordingto one embodiment of the invention. The enhanced messaging system 100allows electronic messages (e.g., text messages) to be sent betweenmobile communication devices. The electronic messages being sent can beenhanced to include status information pertaining to (i) status of theassociated mobile communication devices, (ii) status associated with theenvironment of the mobile communication devices, and/or (iii) status ofthe person(s) using the mobile communication device(s).

The enhanced messaging system 100 includes mobile communication devices102, 104, 106 and 108. The mobile communication devices 102 and 104communicate with a wireless network 110, and the mobile communicationdevices 106 and 108 communicate with a wireless network 112. Thewireless networks 110 and 112 can be the same or different networks andcan utilize same or different protocols. The wireless networks 110 and112 can be coupled together and/or can couple to the Internet 114, andcan support global messaging.

The enhanced messages are sent from one of the mobile communicationdevices to one or more other of the mobile communication devices. Theseenhanced messages can include additional information about the mobilecommunication device, its user and/or its environment. In oneembodiment, the status information can include at least position(location) information and other status information. To provide thestatus information, the mobile communication devices 102, 104, 106 and108 can include one or more status sensors, such as position detectors,and/or one or more other types of condition sensors for differentconditions regarding the communication devices. A position detector canprovide position information pertaining to its corresponding mobilecommunication device. Similarly, a condition sensor provides conditioninformation pertaining to conditions sensed at the corresponding mobilecommunication device. More particularly, the mobile communication device102 includes a position detector 116 and at least one condition sensor118; the mobile communication device 104 includes a position detector120 and at least one condition sensor 122; the mobile communicationdevice 106 includes a position detector 124 and at least one conditionsensor 126; and the mobile communication device 108 includes a positiondetector 128 and at least one condition sensor 130.

In one embodiment, the position information is obtained from a globalpositioning system (GPS) receiver, which can be in a mobilecommunication device. In other words, the position detector can be a GPSreceiver. The position information can be obtained or augmented by alocal positioning system such as utilized with a local network (e.g.,Bluetooth, Wi-Fi, etc.). The conditions information can vary withapplication. Examples of conditions that can be provided within theconditions information include environment conditions or conditions ofthe environment of the corresponding mobile communication device.Environment conditions include temperature, humidity, pressure, gaseousor liquid states, chemical compositions, wind speed, color composition,scent, light, sound, smoke, particle or radiation (e.g., infraredradiation). The conditions information can be pertaining to a mobilecommunication device itself, such as force or pressure asserted on it,or its vibration, acceleration, speed (velocity) or direction. Theconditions information can also include user-related conditions. Theseare conditions related to the user, who is typically a living being andwho may be using the corresponding mobile communication device. Examplesof user-related conditions include the being's physical conditions(e.g., heart beat, temperature, pupil dilation, hunger, perspiration,tired or sick), volitional behavior (e.g., facial expressions, jumpingor moving), or the user's emotional state, such as the user's mood.Examples of emotional states or moods include sad, happy, mad, stressed,or excited. Some of these conditions are not determined directly bysensors, but are instead determined indirectly through processing othersensor data.

In one embodiment, an enhanced messaging system can operate in adistributed manner with little or no centralized management for statusinformation exchange. In other words, the exchange of status informationcan be peer-to-peer (e.g., from one mobile communication device toanother) without an intermediate centralized server to store and managedistribution of the status information. Such an embodiment can operatewithout assistance from wireless networks service providers. Theenhanced messaging system 100 shown in FIG. 1 is suitable for use assuch an embodiment.

In another embodiment, an enhanced messaging system can operate in acentralized manner, such as shown below in FIG. 2. In the case of acentralized system, or at least one providing centralized assistance,the status information can be stored and/or processed by a separateentity, independent of the parties sending and receiving information.

FIG. 2 is a block diagram of an enhanced messaging system 200 accordingto one embodiment of the invention. The enhanced messaging system 200provides web-based enhanced messaging between users of communicationdevices. The enhanced messages being sent from one of the communicationdevices to one or more other of the communication devices. Theseenhanced messages can include additional information pertaining to acommunication device, its user and/or its environment. In oneembodiment, the status information can include at least position(location) information and conditions information.

According to the embodiment shown in FIG. 2, the enhanced messagingsystem 200 includes stationary communication devices 202 and 204. Theenhanced messaging system 200 also includes mobile communication devices(MCD) 206 and 208. Typically, the mobile communication devices 206 and208 are worn by, affixed to or carried by users. The enhanced messagingsystem 200 would normally be able to support multiple stationarycommunication devices, such as desktop computers, and mobilecommunication devices, such as mobile telephones, personal digitalassistants and two-way pagers.

In general, messages can be transmitted (sent and/or received) betweenand/or among any of the communication devices, regardless of whetherstationary or mobile. For discussion, it is assumed that a message iscreated and sent from the mobile communication device 206 to thestationary communication device 204. The message is assumed to be a textmessage, such as a real-time text message (e.g., instant message). Inthis example, the mobile communication device 206 acquires statusinformation pertaining to the user, the device and/or the environment.The acquired status information is provided to the stationarycommunication device 204 along with the message.

The mobile communication devices 206 and 208 couple to a wirelessnetwork 210. The wireless network 210 couples to the Internet 212.Further, a status server 214 is coupled to the Internet 212. The statusserver 214 also couples to a status database 216. The Internet 212 canbe replaced by other data networks (e.g., enterprise network, regionalnetwork, Local Area Network, Wide Area Network and global network).

The status information can include at least position (location)information and conditions information. The position information isobtained typically from a global positioning system (GPS) receiverwithin the first mobile communication device 206. The positioninformation can be obtained or augmented by a local positioning systemsuch as utilized with a local network (e.g., Bluetooth, Wi-Fi, etc.).

The conditions information can vary with application. Various examplesof conditions that can be provided within the conditions informationwere noted above. The corresponding conditions sensor(s) can also be inthe mobile communication device 206, or the sensor(s) can be wired orwirelessly coupled to the mobile communication device 206.

The status information that is obtained by the first mobilecommunication device 206 is sent by the first mobile communicationdevice 206 to the status server 214 via the wireless network 210 and theInternet 212. The status server 214 stores the status informationpertaining to the first mobile communication device 206 into the statusdatabase 216 such that it is associated with the first mobilecommunication device 206. The status server 214 monitors statusinformation for numerous communication devices, including mobilecommunications devices and/or stationary communication device, and thusstores status information pertaining to numerous communication devices.

The enhanced messaging system 200 can also include at least onethird-party 218. The third-party 218 is a user interested in statusinformation acquired by mobile communication devices but does notnormally receive the text messages also being sent.

The enhanced messaging system 200 can allow a recipient of the messageto not only receive the text of the message but also the statusinformation associated with the message. In one embodiment, therecipient receives the status information with the message. Therecipient of the message can, for example, include one or more of themobile communication devices 206 and 208 or one or more of thestationary communication devices 202 and 204, or users thereof. Inanother embodiment, an authorized party, such as the user of thestationary communication devices 202 and 204 or the third-party 218, caninteract with the status server 214 through a web interface so that suchusers are able to access certain status information via the statusserver 214 and the status database 216. The web interface can facilitatea user in accessing status information anytime anywhere.

FIG. 3 is a flow diagram of status message processing 300 according toone embodiment of the invention. The status message processing 300 is,for example, performed by a mobile communication device (e.g., mobiletelephone, two-way pager) or other computing device (e.g., desktopcomputer, gateway, server).

Initially, the status message processing 300 receives 302 a message at afirst mobile communication device. For example, a user of the mobilecommunication device would typically interact with the mobilecommunication device (e.g., through a user interface) to create themessage. Hence, in this embodiment, the message is considered to be auser-entered message. The user-entered message can be a voice message, atext message, a video message or some other type of input, or somecombination thereof. A text message is, for example, a standard emailmessage, a short message (e.g., SMS message) or an instant message.Status information pertaining to the first mobile communication device(and/or its user or environment) can be acquired 304. As noted above, inone embodiment, the status information can include at least position(location) information and/or conditions information. Some or all of thestatus information can then be attached 306 to the user-entered message.In one embodiment, at least some of the status information has beenprocessed before attachment. The processed status information is stillconsidered as status information. With the status information attached306 to the user-entered message, the user-entered message becomes anenhanced message. The enhanced message is then sent 308 from the firstmobile communication device to another electronic device, such as asecond mobile communication device (e.g., mobile telephone, personaldigital assistant, or pager) or other computing device (e.g., portableor stationary computer). Typically, the sending of the enhanced messageinvolves electronic transmission of the enhanced message over a wirelessnetwork as well as perhaps a wired network. Although the enhancedmessage is often sent from one mobile communication device to anothermobile communication device, the message can alternatively be sent toanother computing device, such as a personal computer coupled to thenetwork. Following the operation 308, the status message processing 300is complete and ends.

FIG. 4 is a flow diagram of send processing 400 according to oneembodiment of the invention. The send processing 400 is, for example,performed by a mobile communication device or other computing device.

The send processing 400 initially produces 402 a message. In thisembodiment, the message is a user-entered message such as a textmessage. The text message can, for example, be produced or initiated bya user of the mobile communication device or other computing device.However, in other embodiment, the message can be a voice message or avideo message.

A decision 404 then determines whether status information is to be addedto the text message. The decision 404 allows the user to limit orrestrict the status information that is sent to others. For example, theuser might restrict the status information such that it can only be sentto authorized persons or destinations. The restrictions can be imposedby a profile or configuration information associated with the user. Inone implementation, a user can make use of a list of recipientspermitted to receive status information (e.g., pre-authorizedrecipients). As another example, a dialog box (or other graphical userinterface) could be displayed to allow the user to select none, some orall of the available status information to be sent generally with alltext messages, or specifically with a particular text message. As stillanother example, default authorizations can control the statusinformation that is to be sent to recipients. Yet, in another example,status information can have different levels. Some levels can be moreconfidential than others, or some levels can be more important thanothers. These levels can also be set by the user. Regardless, differentrecipients can receive different levels of status information.

In any case, when the decision 404 determines that status information isto be provided with the text message, the status information is acquired406. The status information is acquired from the mobile communicationdevice or other computing device that is sending the text message. Forexample, the status information can be acquired 406 from a positiondetector and at least one condition sensor within (wired or wirelesslycoupled to) the mobile communication device.

Regardless of how or when acquired, the status information can then beembedded 408 in the text message. Once the status information has beenembedded in 408 (or otherwise combined with or linked to) the textmessage, the resulting message is referred to as an enhanced message.The status information can be embedded in an open (e.g., as additionaldisplayed information) or hidden manner (e.g., as undisplayed text). Inone example, the status information is embedded in the text messageusing a markup language. The status information being embedded in thetext message can also be encrypted, or the entire enhanced message canbe encrypted. After the status information is embedded 408 (as well asdirectly after the decision 404 when no status information is to beadded, the resulting message (regardless of whether enhanced or not) issent 410 to a recipient. The recipient is typically a user of anothermobile communication device or other computing device. However, therecipient can also be the another mobile communication device or othercomputing device. Following the operation 410, the send processing 400is complete and ends.

FIG. 5 is a flow diagram of display processing 500 according to oneembodiment of the invention. The display processing 500 is, for example,performed by a mobile communication device or other computing device.The display processing 500 is, for example, performed in response to amessage being received due to the send processing 400 of FIG. 4. Inother words, the display processing 500 can be performed by a computingdevice associated with a recipient that has received a message.

The display processing 500 begins with a decision 502 that determineswhether a message has been received. When the decision 502 determinesthat a message has not yet been received, then the display processing500 awaits the receipt of a message. On the other hand, when thedecision 502 determines that a message has been received, a decision 504then determines whether any status information is provided with themessage that has been received. Here, the message is examined todetermine whether status information is provided within the message.When the decision 504 determines that status information is providedwith the message (and thus the message is an enhanced message), then thestatus information is extracted 506 from the message.

Next, the message as well as at least one representation of the statusinformation are displayed 508. The representation (e.g., indication) ofthe status information being displayed can vary with implementation. Inone embodiment, the representation is a graphical symbol that representsat least a portion of the status information. For example, a smilingface icon can represent a happy mood, a frown face icon can representthat the user is unhappy, etc. In another embodiment, the representationis textual information that is or represents a portion of the statusinformation. In still another embodiment, the representation is a link(e.g., hyperlink) that provides access to at least a portion of thestatus information. For such representations, the status information canspecify its presentation, or additional processing of the statusinformation can determine an appropriate presentation.

The status information can also be interpreted, analyzed or processedbefore or while the representation to be displayed is determined. In oneembodiment, such interpretation, analysis or processing can beperformed, at least in part, by the device sending the message. As oneexample, the status information can include (or interpreted to include)temperature (e.g., ambient temperature) and user perspiration. Based onthese two pieces of status information, one interpretation is that theuser is perspiring (i.e., sweating) because of the high temperature.

As another example of the interpretation of status information, relativeposition of two computing devices can be computed and displayed. Forexample, if a receiving-computing device (either mobile or stationary)receives position information from a sending-computing device(preferably mobile), then the receiving-computing device (which knowsits position) can determine and display the relative position (e.g.,distance and/or direction) of the sending and the receiving-computingdevices. Further, through use of other conditions information pertainingto the sending-computing device that might also be provided to thereceiving-computing device, the receiving-computing device can alsodisplay the speed (velocity), direction of travel, etc. of thesending-computing device. Through additional interpretation or analysisof the conditions information, the speed (or average speed) could beused to categorize the type of movement of the sending-computing device,which would be available for display, as a symbol or other indication.As examples, the categories could be auto, bicycle, run, fast walk, slowwalk, and stationary.

In yet another example, conditions information can include the user'smood. This can be measured in a number of different ways. One method isdiscussed in U.S. Pat. No. 5,774,591, entitled, “APPARATUS AND METHODFOR RECOGNIZING FACIAL EXPRESSIONS AND FACIAL GESTURES IN A SEQUENCE OFIMAGES,” which is hereby incorporated herein by reference. Suchconditions information can be interpreted at the sending-computingdevice or the receiving-computing device. Conditions information can bea user's stress level. This piece of status information can, forexample, be interpreted and transformed into a symbol, such as astressed-face icon which the stress level is high. In one embodiment,both the raw data and the symbol(s) are transmitted to areceiving-computing device, but with only the symbol being displayed andthe raw data being hidden. By selecting the displayed symbol or throughother appropriate user-input, the receiving-computing device canadditionally analyze or view the raw data.

Alternatively, when the decision 504 determines that status informationis not provided with the message, then the message is displayed 510.Here, there is no status information available to present; therefore,the message is simply displayed. Following the operations 508 and 510,the display processing 500 is complete and ends.

The display processing 500 operates to present at least an indicator orrepresentation of the status information through a display. In anotherembodiment, the status can be presented to the user of the mobilecommunication device or other computing device in other ways. Forexample, the status information could be presented by an audio output(e.g., synthesized voice), a tactile output or other types of outputsthat can be sensed by the user, which is typically a living being, suchas a human being.

In one aspect of the invention, status information can be automaticallyincluded with user-entered messages being sent as noted above. Asanother aspect of the invention, status information can be acquired andpresented on request.

FIG. 6 is a flow diagram of status retrieval processing 600 according toone embodiment of the invention. The status retrieval processing 600 is,for example, performed by a mobile communication device or othercomputing device.

The status retrieval processing 600 begins with a decision 602 thatdetermines whether a status request has been requested. The statusrequest is provided by a requestor to acquire status information fromanother mobile communication device or other computing device. In oneembodiment, the status request is initiated by a requestor. Therequestor can be a user of the mobile communication device or othercomputing device. In another embodiment, the status request can beinitiated by the mobile communication device or other computing device.When the decision 602 determines that a status request has not beenrequested, then the status retrieval processing 600 awaits such arequest.

Once the decision 602 determines that a status request has beenrequested, a status request message is produced 604. The status requestmessage is then sent 606 from the requestor to a recipient. In oneembodiment, the status request message is a short text message (e.g.,SMS message) that need not be displayed at the recipient. A statusrequest message that is not displayed at the recipient can be referredto as a dummy message. The recipient can be another mobile communicationdevice or other computing device, or a user thereof.

Next, a decision 608 determines whether a status response message hasbeen received by the requestor. The status response message includesstatus information associated with the recipient. The status responsemessage is a message sent by the recipient in response to the statusrequest message from the requestor. When the decision 608 determinesthat the status response message has not yet been received, then thestatus retrieval processing 600 awaits receipt of a status responsemessage. On the other hand, when the decision 608 determines that astatus response message (responsive to the status request message) hasbeen received, then the status retrieval processing 600 continues.Namely, status information is extracted 610 from the status responsemessage. Next, at least one representation of the status information isdisplayed 612. The representation can vary with implementation. In oneembodiment, the representation is a graphical symbol that represents atleast a portion of the status information. In another embodiment, therepresentation is text that is or represents a portion of the statusinformation. In another embodiment, the representation is a piece ofvideo clip that is or represents a portion of the status information. Instill another embodiment, the representation is a link (e.g., hyperlink)that provides access to at least a portion of the status information.The status information can also be interpreted, analyzed or processedbefore or while the representation to be displayed is determined.Following the operation 600, the status retrieval processing 600 iscomplete and ends.

FIG. 7 is a flow diagram of status request processing 700 according toone embodiment of the invention. The status request processing 700 is,for example, performed by a mobile communication device or othercomputing device. The status request processing 700 is, for example,performed in response to a status request message of the statusretrieval processing 600 of FIG. 6.

The status request processing 700 begins with a decision 702 thatdetermines whether a status request message has been received. When thedecision 702 determines that a status request message has not yet beenreceived, then the status request processing 700 awaits such a message.Once the decision 702 determines that a status request message has beenreceived, status information for the associated mobile communicationdevice or other computing device or user thereof is acquired 704. Astatus response message is then produced 706 based on the statusinformation. The status response message is then sent 708 to therequestor. The requestor can be considered to be a mobile communicationdevice or other computing device, or a user thereof, that caused thestatus request message to be sent. According to one embodiment, once thestatus response message is sent 708, the operations 610-612 of thestatus retrieval processing 600 of FIG. 6 can be performed.

As described above, status information is typically presented in somemanner at the recipient (often presented concurrently with a message).In other embodiments, the status information can be stored in a databasefor later utilization. The messages can be subsequently searched, sortedor otherwise processed.

In still another aspect of the invention, status information can beautomatically sent to one or more recipients whenever available or whenchanged. For example, one such embodiment could have a mobilecommunication device periodically or on events (e.g., status events)send its status information to another computing device. As anotherexample, status information could be automatically sent to anothercomputing device when changed by more that a threshold amount. Thiswould enable the another computing device to maintain awareness ofup-to-date status information of the mobile communication device. Likeother embodiments, this embodiment can operate in a peer-to-peer manneror in a centralized manner.

Note that status sensors do not have to be embedded in a mobilecommunication device. A status sensor can be physically detached, butelectronically coupled to a communication device through a wirelesslink, such as based on the Bluetooth or Wi-Fi technologies. In yetanother embodiment, a status sensor electronically couples to acommunication device through a wire connection.

In yet another embodiment, the sending of status information can bethrough user-activation. In other words, although a piece of statusinformation is acquired via a status sensor, its transmission to anotherelectronic device can depend on a user's voluntary action, such aspushing a button.

One application of the invention is to provide the status informationwith messages, such as text messages and in particular near real-timetext messages, such as instant messages. Hence, users of computingdevices, namely, mobile communication devices, can exchange nearreal-time text messages and in doing so can also exchange statusinformation. In some embodiments, the exchange of status information isachieved automatically, without user initiation.

The messages can be provided in a markup language format. The statusinformation can be embedded or included in the messages also in a markuplanguage. As examples, the markup language include HTML, HDML, WML, XML,etc. The messages and/or status information can also be provided in aprogramming language format, such as JAVA or C.

Another application of the invention is in the medical area. Forexample, a patient carries a mobile communication device with a positiondetector. He is also carrying one or more status sensors that can sense,for example, his body temperature, blood pressure, blood sugar orglucose level, blood oxygen, spirometry, ECG, heart rate, arrhythmias,brain wave, other sound wave measurable by a stethoscope, and/or bodyfat. The sensors can be non-invasive or invasive. Also, the sensor(s)can be coupled to the device is a wireless or wired manner. Such statusinformation can be transmitted upon his command. In one embodiment, apatient's mobile communication device sends a message (“Very tired.”) toan emergency clinic. It is an enhanced message that includes some of thepatient's status information, such as his physical location and bloodsugar level. In response, a specialist at the clinic sends one or moremessages back, instructing the patient how to care for himself and/orcontrolling the release of insulin into the patient. In the mean time,the specialist can dispatch an ambulance to pick him up.

A number of embodiments have been described based on text messages. Thepresent invention is also applicable to other types of messages, such asvoice messages. In one embodiment, the message is provided with a voicecall, and the mobile communication device is a mobile telephone (e.g.,cell phone).

Also, a number of embodiments have been described regarding a devicesending information to another device. In one embodiment, a device canbroadcast enhanced messages to many devices.

In yet another embodiment, communication among devices can be monitoredand charged by a third party. For example, the user of a communicatingdevice can be billed depending on the amount of enhanced messages he hasbeen sending or the amount or degree of enhancement to messages. In oneembodiment, both the recipient and the sender of the enhanced messagesare billed. In another embodiment, the more types of status messagesincluded, the higher the bill. For example, enhanced messages withposition, temperature and humidity information will cost more thanenhanced messages with just position.

The various aspects can be used separately or in any combination.

The above-described system, methods and processes can be used togetherwith other aspects of a monitoring system or mobile device, includingthe various aspects described in: (i) U.S. Provisional PatentApplication No. 60/444,198, filed Jan. 30, 2003, and entitled “SYSTEM,METHOD AND APPARATUS FOR ACQUIRING, PRESENTING, MONITORING, DELIVERING,MANAGING AND USING STATUS INFORMATION,” which is hereby incorporatedherein by reference; (ii) U.S. Provisional Patent Application No.60/418,491, filed Oct. 15, 2002, and entitled “SYSTEM, METHOD ANDAPPARATUS FOR ACQUIRING, PRESENTING, MONITORING, DELIVERING, MANAGINGAND USING STATUS INFORMATION SYSTEM, METHOD AND APPARATUS FOR ACQUIRING,PRESENTING, MANAGING AND USING POSITION INFORMATION,” which is herebyincorporated herein by reference; (iii) U.S. Provisional PatentApplication No. 60/404,645, filed Aug. 19, 2002, and entitled “SYSTEM,METHOD AND APPARATUS FOR ACQUIRING, PRESENTING, MONITORING, DELIVERING,MANAGING AND USING POSITION AND OTHER INFORMATION,” which is herebyincorporated herein by reference; and (iv) U.S. Provisional PatentApplication No. 60/375,998, filed Apr. 24, 2002, and entitled “SYSTEM,METHOD AND APPARATUS FOR ACQUIRING, PRESENTING, MANAGING AND USINGPOSITION INFORMATION,” which is hereby incorporated herein by reference.

The invention can be implemented in software, hardware or a combinationof hardware and software. The invention can also be embodied as computerreadable code on a computer readable medium. The computer readablemedium can be any data storage device that can store data which canthereafter be read by a computing device. Examples of the computerreadable medium include read-only memory, random-access memory, CD-ROMs,magnetic tape, optical data storage devices, and carrier waves. Thecomputer readable medium can also be distributed over network-coupledcomputer systems so that the computer readable code is stored andexecuted in a distributed fashion.

The advantages of the invention are numerous. Different embodiments orimplementations may yield one or more of the following advantages. Oneadvantage is that status information is able to be obtained easily whileexchanging electronic messages or otherwise through use of electronicmessages. Another advantage of the invention is that messages are ableto be enhanced with status information acquired by sensors. Stillanother advantage of the invention is that it can operate in apoint-to-point or centralized manner to gather and present statusinformation between computing devices (e.g., mobile communicationdevices).

The many features and advantages of the present invention are apparentfrom the written description and, thus, it is intended by the appendedclaims to cover all such features and advantages of the invention.Further, since numerous modifications and changes will readily occur tothose skilled in the art, it is not desired to limit the invention tothe exact construction and operation as illustrated and described.Hence, all suitable modifications and equivalents may be resorted to asfalling within the scope of the invention.

What is claimed is:
 1. A non-transitory computer readable mediumincluding at least computer program code tangibly stored thereon forfacilitating communication among users of mobile electronic devices,said computer readable medium comprising: computer program code forreceiving message content for an electronic message via a first mobileelectronic device; computer program code for acquiring data associatedwith a location of the first mobile electronic device; computer programcode for determining a plurality of other mobile electronic devices orusers thereof that are to receive the electronic message along with theacquired data; computer program code for determining whether at leastone indication has been received from the first mobile electronic deviceto influence whether the acquired data is to be provided with theelectronic message, the at least one indication received beinguser-initiated via the first mobile electronic device and being for theelectronic message; computer program code for determining based at leastin part on the at least one indication whether the acquired data is tobe provided with the electronic message; and computer program code forinitiating sending of the electronic message, including the messagecontent, along with the acquired data to each of the plurality of othermobile electronic devices via at least one wireless network, providedthat the computer program code for determining determines that theacquired data is to be provided with the electronic message, whereineach of the plurality of other mobile electronic devices are enabled toprovide a presentation of at least a portion of the acquired data, andwith the presentation of the at least a portion of the acquired dataincluding at least an audio presentation of the at least a portion ofthe acquired data.
 2. A non-transitory computer readable medium asrecited in claim 1, wherein the presentation of the at least a portionof the acquired data further includes a visual representation of atleast a portion of the acquired data.
 3. A non-transitory computerreadable medium as recited in claim 1, wherein said computer readablemedium comprises: computer program code for facilitating display of avisual representation of at least a portion of the acquired data on eachof the plurality of other mobile electronic devices, provided that thecomputer program code for determining determines that the acquired datais to be provided with the electronic message.
 4. A non-transitorycomputer readable medium as recited in claim 3, wherein the visualrepresentation of at least a portion of the acquired data beingdisplayed is presented in a graphical manner.
 5. A non-transitorycomputer readable medium as recited in claim 1, wherein the messagecontent comprises graphical content.
 6. A non-transitory computerreadable medium including at least computer program code tangibly storedthereon for facilitating communication among users of mobile electronicdevices, said computer readable medium comprising: computer programcode, at a recipient mobile electronic device, for receiving anelectronic message from another mobile electronic device via at leastone wireless network, the received electronic message being wirelesslytransmitted to the recipient mobile electronic device; computer programcode for determining whether the received electronic message has atleast received status information provided therewith; computer programcode for retrieving the received status information provided with thereceived electronic message from the another mobile electronic devicewhen the computer program code for determining determines that thereceived electronic message has at least the received status informationprovided therewith; and computer program code for facilitatingpresentation, at the recipient mobile electronic device, of at least aportion of the received electronic message and at least onerepresentation of at least a portion of the received status informationwhen the computer program code for determining determines that thereceived electronic message has at least the received status informationprovided therewith, wherein the computer program code for facilitatingpresentation of the at least a portion of the received electronicmessage and at least one representation of at least a portion of thereceived status information comprises computer program code forfacilitating audio output, via the recipient mobile electronic device,pertaining to at least a portion of the presentation of the at least onerepresentation of at least a portion of the received status information.7. A non-transitory computer readable medium as recited in claim 6,wherein the presentation of the at least one representation of at leasta portion of the received status information further includes a visualrepresentation of at least a portion of the received status information.8. A non-transitory computer readable medium as recited in claim 7,wherein the message content comprises graphical content, and wherein thevisual representation of at least a portion of the received statusinformation is presented in a graphical manner.
 9. A non-transitorycomputer readable medium as recited in claim 8, wherein the receivedstatus information is associated with a location of the another mobileelectronic device.
 10. A non-transitory computer readable medium asrecited in claim 6, wherein the recipient mobile electronic device is amobile communication device.
 11. A non-transitory computer readablemedium as recited in claim 6, wherein the recipient mobile electronicdevice is a mobile telephone.
 12. A non-transitory computer readablemedium including at least computer program code tangibly stored thereonfor facilitating communication among users of mobile electronic devices,said computer readable medium comprising: computer program code forreceiving message content for an outgoing electronic message via a firstmobile electronic device; computer program code for acquiring dataassociated with a location of the first mobile electronic device;computer program code for determining a plurality of other mobileelectronic devices or users thereof that are to receive the outgoingelectronic message along with the at least a portion of the acquireddata; computer program code for determining whether at least oneindication has been received from the first mobile electronic device toinfluence whether the at least a portion of the acquired data is to beprovided with the outgoing electronic message, the at least oneindication received being user-initiated via the first mobile electronicdevice and being for the outgoing electronic message; computer programcode for determining, based at least in part on the at least oneindication, whether the at least a portion of the acquired data is to beprovided with the outgoing electronic message; computer program code forinitiating sending of the outgoing electronic message along with the atleast a portion of the acquired data to each of the plurality of othermobile electronic devices via at least one wireless network, providedthat the computer program code for determining determines that the atleast a portion of the acquired data is to be provided with the outgoingelectronic message; computer program code for receiving an incomingelectronic message from another mobile electronic device via at leastone wireless network; computer program code for determining whether theincoming electronic message has at least received status informationassociated therewith; computer program code for acquiring the receivedstatus information that has been provided with the incoming electronicmessage from the another mobile electronic device when the computerprogram code for determining whether the incoming electronic message hasat least received status information associated therewith determinesthat the incoming electronic message includes at least the receivedstatus information, the received status information includes at leastreceived acquired data associated with the another mobile electronicdevice; and computer program code for facilitating presentation of atleast a portion of the incoming electronic message and of at least aportion of the received acquired data when the computer program code fordetermining whether the incoming electronic message has at leastreceived status information associated therewith determines that theincoming electronic message includes at least the received statusinformation, wherein the presentation of at least a portion of thereceived acquired data provides an audio output that provides an audiopresentation of at least a portion of the received acquired data.
 13. Anon-transitory computer readable medium as recited in claim 12, whereinthe presentation of at least a portion of the received acquired datadisplays a visual representation of at least a portion of the receivedacquired data.
 14. A non-transitory computer readable medium as recitedin claim 13, wherein the message content comprises graphical content.15. A non-transitory computer readable medium as recited in claim 13,wherein the visual representation of at least a portion of the receivedacquired data being displayed is presented in a graphical manner.
 16. Anon-transitory computer readable medium as recited in claim 12, whereinthe message content comprises graphical content and text content.
 17. Anon-transitory computer readable medium as recited in claim 12, whereinthe computer program code for receiving message content for an outgoingelectronic message comprises computer program code for presenting a userinterface at the first mobile electronic device to enable the messagecontent to be received.
 18. A non-transitory computer readable medium asrecited in claim 12, wherein the computer program code for determining aplurality of other mobile electronic devices or users thereof that areto receive the outgoing electronic message along with the at least aportion of the acquired data comprises computer program code forpresenting a graphical user interface to enable a user of the firstmobile electronic device to designate the plurality of other mobileelectronic devices or users thereof that are to receive the outgoingelectronic message along with the at least a portion of the acquireddata.
 19. A non-transitory computer readable medium as recited in claim18, wherein the computer program code for presenting the graphical userinterface to enable a user of the first mobile electronic device todesignate the plurality of other mobile electronic devices or usersthereof that are to receive the outgoing electronic message along withthe at least a portion of the acquired data comprises computer programcode for presenting a list of potential recipients.
 20. A non-transitorycomputer readable medium as recited in claim 12, wherein the firstmobile electronic device include a hardware sensor, and wherein theacquired data is data acquired from the hardware sensor or derivedtherefrom.